Quality improvement in public-private partnerships in low- and middle-income countries: a systematic review.

BACKGROUND: Public-private partnerships (PPP) are often how health improvement programs are implemented in low-and-middle-income countries (LMICs). We therefore aimed to systematically review the literature about the aim and impacts of quality improvement (QI) approaches in PPP in LMICs. METHODS: We searched SCOPUS and grey literature for studies published before March 2022. One reviewer screened abstracts and full-text studies for inclusion. The study characteristics, setting, design, outcomes, and lessons learned were abstracted using a standard tool and reviewed in detail by a second author. RESULTS: We identified 9,457 citations, of which 144 met the inclusion criteria and underwent full-text abstraction. We identified five key themes for successful QI projects in LMICs: 1) leadership support and alignment with overarching priorities, 2) local ownership and engagement of frontline teams, 3) shared authentic learning across teams, 4) resilience in managing external challenges, and 5) robust data and data visualization to track progress. We found great heterogeneity in QI tools, study designs, participants, and outcome measures. Most studies had diffuse aims and poor descriptions of the intervention components and their follow-up. Few papers formally reported on actual deployment of private-sector capital, and either provided insufficient information or did not follow the formal PPP model, which involves capital investment for a explicit return on investment. Few studies discussed the response to their findings and the organizational willingness to change. CONCLUSIONS: Many of the same factors that impact the success of QI in healthcare in high-income countries are relevant for PPP in LMICs. Vague descriptions of the structure and financial arrangements of the PPPs, and the roles of public and private entities made it difficult to draw meaningful conclusions about the impacts of the organizational governance on the outcomes of QI programs in LMICs. While we found many articles in the published literature on PPP-funded QI partnerships in LMICs, there is a dire need for research that more clearly describes the intervention details, implementation challenges, contextual factors, leadership and organizational structures. These details are needed to better align incentives to support the kinds of collaboration needed for guiding accountability in advancing global health. More ownership and power needs to be shifted to local leaders and researchers to improve research equity and sustainability.

Mapping Online Community Spaces Through Online Focus Group Discussions Among Gay, Bisexual, and Other Men Who Have Sex With Men in Guangdong, China: Implications for Human Immunodeficiency Virus/Sexually Transmitted Disease Prevention Services.

BACKGROUND: Chinese gay, bisexual, and other men who have sex with men (GBMSM) face discrimination in many facility-based health services, thus increasing the importance of online engagement. The purpose of this study was to examine online GBMSM community spaces and implications for HIV/sexually transmitted disease prevention services. METHODS: We conducted a total of 6 online focus group discussions with Chinese GBMSM from Guangdong province on the chat-based platform WeChat in 2021. Focus group discussions were asynchronous, and participants were able to provide and map out online spaces that they had participated in and share their perspectives on online engagement. Data were analyzed through framework analysis. RESULTS: Overall, 48 participants participated. Most were mainly sexually attracted to men (n = 43; 90.0%) and never participated in in-person LGBTQ-related events (n = 29; 60.4%). Participants articulated a typology of online spaces along the axes of whether such spaces were Chinese platforms (vs. non-Chinese) or whether they were GBMSM-specific (vs. non-GBMSM-specific). Participants articulated several advantages of online spaces, including greater anonymity, opportunities for community building, sharing of sexual health information, and being able to meet other GBMSM more efficiently. Drawbacks included the lack of personal connection, lack of safety measures for youth, encountering deception and the use of fake profile pictures, and needing a virtual proxy network to access some websites. Participants provided suggestions to further improve their experiences of online spaces. CONCLUSIONS: Although broad-based, GBMSM-specific messaging can be implemented in Chinese, GBMSM-specific spaces, sexual health messaging may also reach niche GBMSM communities in a variety of non-GBMSM spaces.

ESSENCE: An Implementation Research Program to Scale Up Depression Care in Rural Communities.

BACKGROUND: Task sharing may involve training nonspecialist health workers (NSHWs) to deliver brief mental health interventions. This approach is promising for reducing the global mental health treatment gap. However, capacity is limited for training large cadres of frontline workers in low- and middle-income countries, hindering uptake of these interventions at scale. METHODS: The ESSENCE (enabling translation of science to service to enhance depression care) project in Madhya Pradesh, India, aims to address these challenges through two sequential randomized controlled trials. First, a training trial will evaluate the effectiveness and cost-effectiveness of digital training, compared with conventional face-to-face training, in achieving clinical competency of NSHWs in delivering an intervention for depression. This initial trial will be followed by an implementation trial aimed at evaluating the effectiveness of a remote enhanced implementation support, compared with routine implementation support, in addressing barriers to delivery of depression care in primary care facilities. RESULTS: This project involved developing and pilot testing a scalable smartphone-based program for training NSHWs to deliver a brief psychological intervention for depression screening. This initial research guided a randomized trial of a digital training approach with NSHWs to evaluate the effectiveness of this approach. This trial will be followed by a cluster-randomized trial to evaluate the effectiveness of remote implementation support in ensuring efficient delivery of depression care in primary care facilities. NEXT STEPS: Findings from these trials may inform sustainable training and implementation support models to integrate depression care into primary care for scale-up in resource-constrained settings.

Prosocial Interventions and Health Outcomes: A Systematic Review and Meta-Analysis.

Importance: Prosocial interventions encourage voluntary actions that benefit others. Community solidarity in response to the COVID-19 pandemic, expanding mutual aid programs, and health workforce issues have accelerated prosocial health interventions. Objective: To investigate the association of prosocial interventions with health outcomes in clinical trials and observational studies. Data Sources: In this systematic review and meta-analysis informed by the Cochrane Handbook for Systematic Reviews of Interventions, 5 databases (MEDLINE [via PubMed], Embase, CINAHL, PsycInfo, and Scopus) were searched from database inception through February 23, 2023. The search included terms for altruism and prosocial behaviors, health outcomes, and study type. Study Selection: Included studies, determined by multiple reviewers, compared health outcomes in a prosocial intervention group with a nonintervention group. Data Extraction and Synthesis: Following the Preferred Reporting Items for Systematic Reviews and Meta-analyses guideline, data extraction and synthesis captured quantitative and qualitative data. To pool data from quantitative studies, random-effects meta-analyses were used to estimate the impact of prosocial interventions. To combine data from quantitative and qualitive studies, data were transformed into qualitative narratives using meta-aggregation. Main Outcomes and Measures: The main outcome was whether prosocial interventions were associated with improved health outcomes. Barriers to and facilitators of implementation of these interventions were assessed. Results: The search identified 5229 citations; 30 studies were included in the synthesis. Studies indicated that prosocial interventions were associated with positive health outcomes for givers (17 studies [56.7]) and recipients (8 [26.7%]). Prosocial interventions included acts of kindness (12 studies [40.0%]), cash gifts (7 [23.3%]), pay-it-forward approaches (6 [20.0%]), and expressions of kindness (5 [16.7%]). Improvements were reported in depression, testing for sexually transmitted diseases, vaccine uptake, physical activity, and individual biomarkers. Data from 6 studies (20.0%) demonstrated that pay-it-forward approaches were associated with increased uptake of diagnostic tests or vaccines among vulnerable groups (moderate certainty of evidence). Data from 14 studies (46.7%) suggested that community connectedness facilitated prosocial interventions. Shared vulnerabilities among groups (eg, sexual minority individuals, older adults) may provide a context for collective mobilization to improve health in local communities. Conclusions and Relevance: This systematic review and meta-analysis found that prosocial interventions were associated with improved health outcomes among vulnerable groups and have been useful for addressing health disparities. Further research is needed to develop and evaluate prosocial interventions.

Implementation matters: assessing the effectiveness and sustainment of an obstetric triage program at a high-volume facility in Ghana.

BACKGROUND: Maternal mortality remains stubbornly high in Ghana. Current national efforts are focused on improving the quality of care offered in health facilities. Obstetric triage is one intervention that has been proposed to improve the timeliness and appropriateness of care, two key elements of quality. In this study, we describe and evaluate a theory-based implementation approach to introduce obstetric triage into Tema General Hospital, a high-volume maternity hospital in Greater Accra, that blends concepts from implementation science and quality improvement. This implementation project was a first attempt to scale this intervention into a new facility, following initial development in the Greater Accra Regional Hospital (formerly Ridge Hospital) in Accra. METHODS: This was a retrospective mixed-methods evaluation of two stages of implementation: active implementation and sustainment. We triangulated monitoring data captured during active implementation with clinical outcome data (timeliness of first assessment, accuracy of diagnosis, and appropriateness of care plan) from direct observation or patient obstetric triage assessment forms at baseline, at the completion of the active implementation stage, and following a 12-month "washout" period with no contact between hospital staff and the purveyor organization. Finally, we assessed embeddedness of the new triage procedures using the NoMad, a quantitative assessment of constructs from normalization process theory (NPT). RESULTS: Patient waiting time decreased substantially during the study. At baseline, the median arrival-to-assessment waiting time was 70.5 min (IQR: 30.0-443.0 min). Waiting time decreased to 6.0 min (IQR: 3.0-15.0 min) following active implementation and to 5.0 min (IQR: 2.0-10.0 min) during the sustainment period. Accuracy of diagnosis was high at the end of active implementation (75.7% correct) and improved during the sustainment period (to 77.9%). The appropriateness of care plans also improved during the sustainment period (from 66.0 to 78.9%). Per NoMad data, hospital staff generally perceive obstetric triage to be well integrated into the facility. CONCLUSIONS: This theory-based implementation approach proved to be successful in introducing a novel obstetric triage concept to a busy high-volume hospital, despite resource constraints and a short implementation window. Results proved long-lasting, suggesting this approach has high potential for engendering sustainability in other facilities as well. Our approach will be useful to other initiatives that aim to utilize program data to create and test implementation theories.

Pay-it-forward gonorrhea and chlamydia testing among men who have sex with men and male STD patients in China: the PIONEER pragmatic, cluster randomized controlled trial protocol.

BACKGROUND: Gonorrhea and chlamydia are the most common sexually transmitted diseases (STDs) among men who have sex with men (MSM) in China. Previous studies have shown pay-it-forward (PIF) interventions to be associated with a substantial increase in gonorrhea and chlamydia test uptake compared to standard-of-care. We propose a 'pay-it-forward' gonorrhea and chlamydia testing randomized controlled trial (PIONEER). The trial would evaluate the effectiveness of two pay-it-forward strategies in promoting testing uptake compared to the standard of care (in which men pay for their tests out-of-pocket) among MSM and male STD patients in China. METHODS: PIONEER will be a three-armed, pragmatic cluster randomized controlled trial (RCT), conducted across 12 clinics (six MSM-led and six public STD clinics) to compare the effectiveness of three implementation strategies. Each facility will be randomized to a standard pay-it-forward intervention of gonorrhea/ chlamydia testing with minimal encouragement for testing, a community-engaged pay-it-forward arm, or a control arm where men pay for their tests out-of-pockets. The primary outcome will be dual gonorrhea/chlamydia test uptake. Secondary outcomes will include syphilis testing, amount donated in pay-it-forward, number of positive gonorrhea and chlamydia tests, and measures of antimicrobial resistance. A sequential transformative mixed methods design will be used to evaluate the implementation process in type 2 effectiveness-implementation hybrid design. Data sources will include survey on acceptability, and feelings and attitudes towards the interventions among participants; testing and treatment uptake data from clinic records, WeChat records, and qualitative data to gain insights into men's perceptions and attitudes towards the pay-it-forward, mechanisms driving uptake, and donating behaviors. Implementers and organizers will be interviewed about fidelity and adherence to protocol, sustainability of pay-it-forward intervention, and barriers and facilitators of implementing the intervention. DISCUSSION: PIONEER will substantially increase gonorrhea/chlamydia testing among MSM in China, providing an innovative and new financial mechanism to sustain STD screening among sexual minorities in low- and middle-income countries. This study will answer compelling scientific questions about how best to implement pay-it-forward and the individual and organizational characteristics that moderate it. TRIAL REGISTRATION: The study with identification number NCT05723263 has been registered on clinicaltrials.gov/.

Recent Progress in Neonatal Global Health Quality Improvement.

Quality improvement methodologies, coupled with basic neonatal resuscitation and essential newborn care training, have been shown to be critical ingredients in improving neonatal mortality. Innovative methodologies, such as virtual training and telementoring, can enable the mentorship and supportive supervision that are essential to the continued work of improvement and health systems strengthening that must be done after a single training event. Empowering local champions, building effective data collection systems, and developing frameworks for audits and debriefs are among the strategies that will create effective and high-quality health care systems.

Using the consolidated framework for implementation research to identify recruitment barriers and targeted strategies for a shared decision-making randomized clinical trial in pediatric sickle cell disease.

BACKGROUND/AIMS: Recruitment is often a barrier in clinical trials that include minoritized populations, such as individuals with sickle cell disease. In the United States, the majority of people with sickle cell disease identify as Black or African American. In sickle cell disease, 57% of the United States trials that ended early did so due to low enrollment. Thus, there is a need for interventions that improve trial enrollment in this population. After lower-than-expected recruitment during the first 6 months of the Engaging Parents of Children with Sickle Cell Anemia and their Providers in Shared-Decision-Making for Hydroxyurea trial, a multi-site study for young children with sickle cell disease, we collected data to understand barriers and used the Consolidated Framework for Implementation Research to categorize them and guide the development of targeted strategies. METHODS: Study staff used screening logs and coordinator and principal investigator calls to identify recruitment barriers that were then mapped onto Consolidated Framework for Implementation Research constructs. Targeted strategies were implemented during Months 7-13. Recruitment and enrollment data were summarized before (Months 1-6) and during the implementation period (Months 7-13). RESULTS: During the first 13 months, 60 caregivers (M = 30.65 years; SD = 6.35) enrolled in the trial. Most caregivers primarily self-identified as female (n = 54, 95%) and African American or Black (n = 51, 90%). Recruitment barriers mapped onto three Consolidated Framework for Implementation Research constructs: (1) Process barriers (i.e. no identified "site champion" and poor recruitment planning at several sites); (2) Inner setting barriers (i.e. limited communication, low relative study priority at several sites); and (3) Outer setting barriers (i.e. poor patient attendance at clinic appointments). Targeted strategies to improve recruitment included (1) principal investigator site visits and retraining on recruitment procedures to address process barriers; (2) increased frequency of communication through all coordinator, site principal investigator, and individual site calls to address inner setting barriers; and (3) development and implementation of no-show procedures for clinic appointments to address outer setting barriers. After implementation of the recruitment strategies, the number of caregivers identified for pre-screening increased from 54 to 164, and enrollment more than tripled from 14 to 46 caregiver participants. CONCLUSION: Consolidated Framework for Implementation Research constructs guided the development of targeted strategies that increased enrollment. This reflective process reframes recruitment challenges as the responsibility of the research team rather than characterizing minoritized populations as "difficult" or "hard to reach." Future trials including patients with sickle cell disease and minoritized populations may benefit from this approach.

Building local decision-making competencies during COVID-19: Accelerating the transition from learning healthcare systems to learning health communities.

Introduction: The persisting and evolving COVID-19 pandemic has made apparent that no singular policy of mitigation at a regional, national or global level has achieved satisfactory and universally acceptable results. In the United States, carefully planned and executed pandemic policies have been neither effective nor popular and COVID-19 risk management decisions have been relegated to individual citizens and communities. In this paper, we argue that a more effective approach is to equip and strengthen community coalitions to become local learning health communities (LLHCs) that use data over time to make adaptive decisions that can optimize the equity and well-being in their communities. Methods: We used data from the North Carolina (NC) county and zip code levels from May to August 2020 to demonstrate how a LLHC could use statistical process control (SPC) charts and simple statistical analysis to make local decisions about how to respond to COVID-19. Results: We found many patterns of COVID-19 progression at the local (county and zip code) levels during the same time period within the state that were completely different from the aggregate NC state level data used for policy making. Conclusions: Systematic approaches to learning from local data to support effective decisions have promise well beyond the current pandemic. These tools can help address other complex public health issues, and advance outcomes and equity. Building this capacity requires investment in data infrastructure and the strengthening of data competencies in community coalitions to better interpret data with limited need for advanced statistical expertise. Additional incentives that build trust, support data transparency, encourage truth-telling and promote meaningful teamwork are also critical. These must be carefully designed, contextually appropriate and multifaceted to motivate citizens to create and sustain an effective learning system that works for their communities.

Developing capacity for learning community systems: Experiences from the 100 Million Healthier Lives SCALE Initiative.

Introduction: This paper explores the capabilities that contribute to community transformation and the common pathways followed by communities in the 100 Million Healthier Lives SCALE (Spreading Community Accelerators through Learning and Evaluation) initiative in their transformation journeys towards a "Culture of Health". Methods: Funded by the Robert Wood Johnson Foundation (RWJF), from 2016 to 2020, between 18 to 24 community coalitions nationwide participated in SCALE, the goal of which was to co-design, implement, test, and scale up a model called the Community of Solutions (COS) Framework, that built community capacity around a set of skills and behaviors to advance culture change and create sustainable improvement in health, well-being, and equity. We adapted and applied two qualitative research techniques, meta-ethnography and participatory action synthesis, to evaluate SCALE initiative data. Results: Eight concepts emerged that represent the knowledge, capabilities and practices commonly acquired and utilized across the communities. Overall, these concepts emphasize individual and team leadership, quality improvement skills, an intentional focus on equity, and partnerships for spread and sustainment. Concepts were linked into lines of arguments which were unique storylines explaining the transformation pathways. Three stories of the transformation process emerged from the data. Causal Loop Diagrams (CLDs) were created to represent non-linear system relationships and visually capture some of the most important dynamics of the process of transformation. Even with vast heterogeneity among the SCALE communities and the diversity of activities that the communities undertook, our analysis showed there were a few basic principles that undergirded the process of building capability for transformation. Conclusions: The knowledge from our findings should be useful to expand further research and practice in community learning systems.

A learning approach to community response during the COVID-19 pandemic: Applying the Cynefin framework to guide decision-making.

Introduction: The United States has been unsuccessful in containing the rapid spread of COVID-19. The complex epidemiology of the disease and the fragmented response to it has resulted in thousands of ways in which spread has occurred, creating a situation where each community needs to create its own local, context-specific learning model while remaining compliant to county or state mandates. Methods: In this paper, we demonstrate how cross sector collaborations can use the Cynefin Framework, a tool for decision-making in complex systems, to guide community response to the COVID-19 pandemic. Results: We explore circumstances under which communities can inhabit each of the four domains of systems complexity represented in the Cynefin framework: simple, complicated, chaotic, and complex, and describe the decision-making process in each domain that balances health, economic, and social well-being. Conclusion: This paper serves as a call to action for the creation of community learning systems to improve community resilience and capacity to make better-informed decisions to address complex public health problems during the pandemic and beyond.

The "case" for case studies: why we need high-quality examples of global implementation research.

Rigorous and systematic documented examples of implementation research in global contexts can be a valuable resource and help build research capacity. In the context of low- and middle-income countries (LMICs), there is a need for practical examples of how to conduct implementation studies. To address this gap, Fogarty's Center for Global Health Studies in collaboration with the Cincinnati Children's Hospital Medical Center and the National Cancer Institute is commissioning a collection of implementation science case studies in LMICs that describe key components of conducting implementation research, including how to select, adapt, and apply implementation science models, theories, and frameworks to these settings; develop and test implementation strategies; and evaluate implementation processes and outcomes. The case studies describe implementation research in various disease areas in LMICs around the world. This commentary highlights the value of case study methods commonly used in law and business schools as a source of "thick" (i.e., context-rich) description and a teaching tool for global implementation researchers. It addresses the independent merit of case studies as an evaluation approach for disseminating high-quality research in a format that is useful to a broad range of stakeholders. This commentary finally describes an approach for developing high-quality case studies of global implementation research, in order to be of value to a broad audience of researchers and practitioners.

Beyond Virtue-Signaling: Advancing Equity Through Design Justice and Public Health Critical Race Praxis.

As public health mourns the inequitable loss of lives to coronavirus disease 2019 (COVID-19) and confronts other major social crises, practitioners must explicitly address systems of oppression in their everyday praxis. We describe how the principles of public health critical race praxis (PHCRP) and design justice (DJ) can advance equity in public health. We begin with an overview of PHCRP and DJ, and develop an integrated approach to facilitate community-led change. We apply this approach to the example of COVID-19 vaccine distribution and conclude with a call to action, arguing for PHCRP and DJ to become integral part of public health practice.

Implementation Science and Implementation Science Communications: a refreshed description of the journals' scope and expectations.

This editorial provides a comprehensive consolidated overview of the scope and expectations of Implementation Science and Implementation Science Communications. We remain most interested in rigorous empirical studies of the implementation of evidence-based healthcare practices (including interventions, technologies, and policies) and the de-implementation of practices that are demonstrated to be of low or no benefit. Implementation strategies (e.g., continuing professional education, organizational changes, and financial incentives to enhance the uptake of evidence-based practices) are of central interest to the journals. We see the field as large and complex, with a wide literature that is published in many venues. We urge people for whom it is new to spend some time reading the existing literature, and learning the scope of the work that has already been done, and published, in our journals and in an increasing number of other journals in the field.

Learning needs assessment for multi-stakeholder implementation science training in LMIC settings: findings and recommendations.

BACKGROUND: Despite significant progress in the field of implementation science (IS), current training programs are inadequate to meet the global need, especially in low-and middle-income countries (LMICs). Even when training opportunities exist, there is a "knowledge-practice gap," where implementation research findings are not useful to practitioners in a field designed to bridge that gap. This is a critical challenge in LMICs where complex public health issues must be addressed. This paper describes results from a formal assessment of learning needs, priority topics, and delivery methods for LMIC stakeholders. METHODS: We first reviewed a sample of articles published recently in Implementation Science to identify IS stakeholders and assigned labels and definitions for groups with similar roles. We then employed a multi-step sampling approach and a random sampling strategy to recruit participants (n = 39) for a semi-structured interview that lasted 30-60 min. Stakeholders with inputs critical to developing training curricula were prioritized and selected for interviews. We created memos from audio-recorded interviews and used a deductively created codebook to conduct thematic analysis. We calculated kappa coefficients for each memo and used validation techniques to establish rigor including incorporating feedback from reviewers and member checking. RESULTS: Participants included program managers, researchers, and physicians working in over 20 countries, primarily LMICs. The majority had over 10 years of implementation experience but fewer than 5 years of IS experience. Three main themes emerged from the data, pertaining to past experience with IS, future IS training needs, and contextual issues. Most respondents (even with formal training) described their IS knowledge as basic or minimal. Preferences for future training were heterogeneous, but findings suggest that curricula must encompass a broader set of competencies than just IS, include mentorship/apprenticeship, and center the LMIC context. CONCLUSION: While this work is the first systematic assessment of IS learning needs among LMIC stakeholders, findings reflect existing research in that current training opportunities may not meet the demand, trainings are too narrowly focused to meet the heterogeneous needs of stakeholders, and there is a need for a broader set of competencies that moves beyond only IS. Our research also demonstrates the timely and unique needs of developing appropriately scoped, accessible training and mentorship support within LMIC settings. Therefore, we propose the novel approach of intelligent swarming as a solution to help build IS capacity in LMICs through the lens of sustainability and equity.

The community transformation map: A maturity tool for planning change in community health improvement for equity and well-being.

Transforming communities to be healthier and more equitable prosents a systemic challenge best addressed by those with native knowledge of the system. Community coalitions are a promising structure for tackling local health inequities, if they approach the change process with multiple local stakeholders and with systemic change in mind. Maturity models offer a framework for system assessment by defining sequential stages toward ideal development. Providing coalitions with a structure for self-assessing community change, the Community Transformation Map (CTM) is a maturity model that operationalizes concepts hypothesized to foster systemic change. This 40-item tool encourages self-assessment, dialogue, and reconciliation of community transformation priorities via an appreciative inquiry process. The CTM was created and applied with 18 community coalitions participating in the 100 Million Healthier Lives initiative. It was iteratively drafted with representatives from across the initiative. These coalitions self-administered the CTM four times over 24 months. Coalitions used the CTM to reconcile perspectives, identify priorities, and create transformation action plans. After the fourth administration, ten semistructured interviews were conducted with coalition members. Thematic analysis revealed good contextual validity. Coalitions saw value in the CTM's productive dialogue and the shared understanding it created, but reported perceived burden in conducting repeated administration. The CTM's value is in structuring community members' reflection on complex, systemic problems. The CTM is rooted in international improvement and change principles and continues to be adapted for other change initiatives. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Evaluating human-centred design for public health: a case study on developing a healthcare app with refugee communities.

BACKGROUND: Australian women from migrant and refugee communities experience reduced access to sexual and reproductive healthcare. Human-centred design can be a more ethical and effective approach to developing health solutions with underserved populations that are more likely to experience significant disadvantage or social marginalisation. This study aimed to evaluate how well Shifra, a small Australian-based not-for-profit, applied human-centred design when developing a web-based application that delivers local, evidence-based and culturally relevant health information to its non-English speaking users. METHODS: This study undertook a document review, survey, and semi-structured interviews to evaluate how well Shifra was able to achieve its objectives using a human-centred design approach. RESULTS: A co-design process successfully led to the development of a web-based health app for refugee and migrant women. This evaluation also yielded several important recommendations for improving Shifra's human-centred design approach moving forward. CONCLUSIONS: Improving refugees' access to sexual and reproductive health is complex and requires innovative and thoughtful problem solving. This evaluation of Shifra's human-centred design approach provides a helpful and rigorous guide in reporting that may encourage other organisations undertaking human-centred design work to evaluate their own implementation.

Australian women from non-English speaking migrant and refugee communities face reduced access to sexual and reproductive healthcare and many then go on to experience poor health outcomes as a result. There is an urgent need for new approach to improve access to healthcare for underserved communities, one that centres these women in the process of finding, developing and disseminating the solutions themselves. Human-centred design can be a more ethical and effective methodology in working with communities to develop these health solutions.This study aimed to evaluate how well Shifra, a small Australian-based not-for-profit focused on improving access to healthcare for refugees and new migrants, undertook human-centred design approach when developing a Smartphone app that delivers local, safe and culturally relevant health information to non-English speaking Australians. The authors interviewed refugees, health and social sector experts and computer programmers involved in creating Shifra to evaluate how well they used human-centred design to achieve its goals. This evaluation found that Shifra's approach was successful whilst also highlighting several important recommendations for improving collaborative efforts with refugee communities. These findings could help other projects also seeking to undertake an authentic community co-design process.

Assessment of a Crowdsourcing Open Call for Approaches to University Community Engagement and Strategic Planning During COVID-19.

Importance: Reimagining university life during COVID-19 requires substantial innovation and meaningful community input. One method for obtaining community input is crowdsourcing, which involves having a group of individuals work to solve a problem and then publicly share solutions. Objective: To evaluate a crowdsourcing open call as an approach to COVID-19 university community engagement and strategic planning. Design, Setting, and Participants: This qualitative study assessed a crowdsourcing open call offered from June 16 to July 16, 2020, that sought ideas to inform safety in the fall 2020 semester at the University of North Carolina at Chapel Hill (UNC). Digital methods (email and social media) were used for promotion, and submissions were collected online for 4 weeks. Participation was open to UNC students, staff, faculty, and others. Main Outcomes and Measures: Submissions were evaluated for innovation, feasibility, inclusivity, and potential to improve safety and well-being. Demographic data were collected from submitting individuals, and submissions were qualitatively analyzed for emergent themes on challenges with and solutions for addressing safety and well-being in the fall semester. Data were shared with UNC leadership to inform decision-making. Results: The open call received 82 submissions from 110 participants, including current UNC students (56 submissions [68%]), people younger than 30 years (67 [82%]), women (55 [67%]), and individuals identifying as a racial/ethnic minority or as multiracial/ethnic (49 [60%]). Seven submissions were identified as finalists and received cash prizes with the encouragement to use these funds toward idea development and implementation. Seventeen runner-up teams were linked to university resources for further development. Thematic analysis of submissions regarding challenges with the fall semester revealed not only physical health concerns and the limitations of remote learning but also challenges that have been exacerbated by the pandemic, such as a lack of mental health support, structural racism and inequality, and insufficient public transportation. Solutions included novel ideas to support mental health among specific populations (eg, graduate students and racial/ethnic minorities), improve health equity, and increase transit access. All 24 finalists and runners-up indicated interest in implementation after being notified of the open call results. Conclusions and Relevance: This study suggests that open calls are a feasible strategy for university community engagement on COVID-19, providing a stakeholder-driven approach to identifying promising ideas for enhancing safety and well-being. Open calls could be formally incorporated into university planning processes to develop COVID-19 safety strategies that are responsive to diverse community members' concerns.

Correction: Exploring factors affecting quality implementation of lymphatic filariasis mass drug administration in Bole and Central Gonja Districts in Northern Ghana.

[This corrects the article DOI: 10.1371/journal.pntd.0007009.].